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Active vision means that visual perception not only depends closely on the subject's 
own movements, but that these movements actually contribute to the visual perceptual 
processes. Vertebrates' and invertebrates' eye movements are probably part of an active 
visual process, but their exact role still remains to be determined. In this paper, studies on 
the retinal micro-movements occurring in the compound eye of the fly are reviewed. Several 
authors have located and identified the muscles involved in these small retinal movements. 
Others have established that these retinal micro-movements occur in walking and flying 
flies, but their exact functional role still remains to be determined. Many robotic stud- 
ies have been performed in which animals' (flies' and spiders') miniature eye movements 
have been modeled, simulated, and even implemented mechanically. Several robotic plat- 
forms have been endowed with artificial visual sensors performing periodic micro-scanning 
movements. Artificial eyes performing these active retinal micro-movements have some 
extremely interesting properties, such as hyperacuity and the ability to detect very slow 
movements (motion hyperacuity). The fundamental role of miniature eye movements still 
remains to be described in detail, but several studies on natural and artificial eyes have 
advanced considerably toward this goal. 
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1. INTRODUCTION 

In their discussion about hoverflies visual flight control, Collett 
and Land (1975) argued that an animal might be capable of deal- 
ing with a constantly moving image on the basis of head and body 
movements, but its behavior would be different in this case. How- 
ever, retinal micro-movements do occur in hoverflies and flies, due 
to the presence of a muscle in charge of moving the retina (Burtt 
and Patterson, 1970). 

Many studies have been published on the micro-movements 
produced by human eyes (for a review of the literature on micro- 
saccades, see Rolfs, 2009) their characteristics (their amplitude, 
frequency, etc.), their role, their neural basis, etc. However, much 
less attention has been paid so far to this topic in the case of inver- 
tebrates. The small amplitude eye movements known to occur 
in humans have been classified in three categories: tremor, drift, 
and micro-saccades (Carpenter, 1988). Ocular micro-movements 
are also known to occur in invertebrates, since scanning micro- 
movements have been observed in several invertebrates such as 
crabs (Burrows and Horridge, 1968; Sandeman, 1978), arachnids 
(Land, 1969), mollusks (Land, 1982; Kaps and Schmid, 1996), and 
flies (see Retinal Micro-Movements in the Fly's Compound Eye: 
A Review). All these studies are an endless source of inspiration 
for developing new sensing techniques such as those presented in 
Section "Bio-Inspired Visual Sensors Mimicking Animals' Micro 
Eye Movements" of this review. However, as discussed by Webb 
(2000) and recalled by De Rossi and Pieroni (2013), the bio- 
inspired sensors presented here can also be used to test the validity 
of biological hypotheses. 



The main role of micro-eye movements is certainly to generate 
temporal changes serving mainly to prevent the occurrence of the 
visual adaptation (fading), which normally occurs when images 
are perfectly stabilized on the retina. However, recent findings on 
humans (Ko et al, 2010; Kuang et al., 2012; Martinez-Conde et al., 
2013) tend to prove that micro-saccades also contribute impor- 
tantly to the processes involved in hyperacuity. An interesting 
suggestion has been made by Ahissar and Arieli (2012), according 
to which the temporal encoding and decoding of the visual signals 
resulting from fixational eye movements may result in highly acute 
vision, as long as some assumptions about the velocity of the eye 
movements prove to be true. 

Hyperacuity, which is defined in detail in Section "Some 
Findings on Visual Acuity," depends on the ability to locate an 
object with greater accuracy than that imposed by the photore- 
ceptor's pitch. The artificial micro-scanning sensors, depicted in 
Section "Bio-Inspired Visual Sensors Mimicking Animals' Micro 
Eye Movements," driving robots periodic eye micro-movements 
certainly do promote hyperacuity. 

2. RETINAL MICRO-MOVEMENTS IN THE FLY'S COMPOUND 
EYE: A REVIEW 

In their 1965 study, Kuiper and Leutscher-Hazelhoff described 
what they called clock-spikes occurring in the third ganglion 
layer of the optic lobe (Kuiper and Leutscher-Hazelhoff, 1965). 
Although the firing rate was found to be very consistent (50 Hz) 
whatever the type of stimulus used (electric light, flash light, etc.), 
it increased with the temperature. As the authors thought it was 
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unlikely that flies might be equipped with a built-in thermometer, 
they suggested that "clock-spikes" might provide the visual system 
with inputs serving to locate objects, but the insect had to be aware 
of its velocity and the line of sight of the ommatidium of inter- 
est. A few years later, by placing a micro-electrode (30 |xm in size) 
in contact with a specific muscle in the blowfly's head called the 
orbito-tentorialis muscle (MOT), which is attached to the back 
of the head (the fixed part) and the base of the photoreceptor 
layer (the moving part), Burtt and Patterson (1970) established 
that the MOT is responsible for generating these clock-spikes (see 
Figure 1). 

Although Kuiper and Leutscher-Hazelhoff did not observe any 
responses to light in the MOT, Burtt and Patterson recorded 
a marked change in the firing rates in response to sud- 
den light variations, although no rhabdomere movements were 
recorded under steady light conditions (Burtt and Patterson, 1970; 



Patterson, 1973b). Preliminary studies showed that the activity of 
the MOT might be correlated with the movement of a pattern 
crossing the visual field (Hengstenberg, 1971, 1972). However, 
the movements of the photoreceptors relative to the lens and the 
correlations possibly existing between locomotion and photore- 
ceptor movements still remained to be investigated (see Section 
"Recording the Fly's Photoreceptor Movements"). 

2.1. RECORDING THE FLY'S PHOTORECEPTOR MOVEMENTS 

Burtt and Patterson (1970) used antidromic light (Gemperlein 
and Jarvilehto, 1969) to study the movement of the rhabdomeres. 
Other authors used a method consisted in examining the move- 
ments of the deep pseudopupil (DPP, Franceschini and Kirschfeld, 
1971) elicited by angular shifts of the photoreceptors' optical axes. 
Hengstenberg (1971, 1972) reported that the DPP movements 
were correlated with changes in the light intensity (see Figure 2), 




Muscle Retina 



FIGURE 1 | (A) Top view of a fly's head showing the 
orbito-tentorialis muscle (MOT in red) attached to the back of the 
head (the fixed part: TT) and the base of the retina (the moving part: 
RET). The two spikes recorded (one generated by the nerve and 



one by the MOT) show that extracellular recordings can be used to 
record the activity of this muscle. Adapted from (Hengstenberg, 
1972). (B) Head of a Calliphora vomitoria (Picture: J. J. Harrison, 
Wikimedia commons). 
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FIGURE 2 | Simultaneous recordings of the MOT spike frequency (A) and the light reflected by the anterior deep pseudopupil (DPP) (B) in the 
housefly. It is clearly shown that the activity of MOT elicits a displacement of the DPP causing an angular shift of the photoreceptors' optical axes. Adapted 
from (Hengstenberg, 1972). 
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FIGURE 3 | Feedback-loop speed control system possibly involved in 
MOT activity. The closed-loop would reduce the slip speed between the 
target motion (v„) and the angular speed of the visual axes (v„). In this 
model, the periodic response of the muscle is seen to be triggered by an 
external signal acting as an input disturbance on the visual feedback loop. 
K m and K m are two pure gains, whereas the clock block can be regarded as 
a periodic signal generator. Reproduced with permission from Northrop 
(2001). 



whereas Franceschini et al. (1991) recorded the activity of the 
MOT and the orbito-scapalis muscle (MOS) simultaneously in 
the walking fly and correlated these activities with the micromet- 
ric movements of the ipsilateral photoreceptors measured optically 
on the DPP (Franceschini et al., 1995; Franceschini and Chagneux, 
1997). Franceschini et al. were the first to report the occurrence 
of large decreases (from 120 to 40 Hz) in the spike firing rates of 
the MOT and the MOS and a scanning amplitude in the order 
of 0.5-lAcp, with A<p the angle between two adjacent omma- 
tidia (see review by Land, 1997). In addition, the spike firing 
rate decreases observed in the two muscles were not always syn- 
chronous, reflecting the complexity of the 2-D movements made 
by the photoreceptors. Similar periodic gaze shifts to the human 
micro-nystagmus (see review by Rolfs, 2009) have been observed in 
studies on the flying fly (Franceschini and Chagneux, 1997), where 
Franceschini and Chagneux reported that the frequency of the 
quasi-periodic scanning of the visual axes ranged approximately 
between 5 and 6 Hz. In a recent study on the fixed Calliphora 
blowfly, in which video analysis was combined with intracellular 
electrophysiological photoreceptor recordings, retinal movements 
of 0.35°(about 0.3Atp) were found to be associated with peri- 
odic eye movements with a frequency of 5-7 Hz (Ciobanu et al, 
2013). 

2.2. MODEL FOR THE FLY'S EYE MUSCLE ACTIVITY 

Burtt and Patterson (1970) have reported that changes in the MOT 
firing rate can also be induced by moving a large striped pattern 
across the visual field. As discussed by Patterson (1973a), the level 
of illumination can affect the MOT activity and thus result, via a 
feedback mechanism, in the micro-scanning of the visual images 
by the photoreceptors. The following fundamental question was 
addressed by Qi and Northrop (1989) and Northrop (2001): how 
is eye muscle activity affected by visual stimulation? These authors 
investigated this question closely by placing a vertical stripe mov- 
ing side to side in front of a fixed Calliphora fly while recording 
the MOT activity (action potentials). Based on the results obtained 
using several moving stimuli (sinusoidal and triangular displace- 
ment laws and even stepwise movements of the vertical stripe), 
Northrop and Qi concluded that the left and right MOT activities 
were apparently correlated with the speed of the moving stripe. 
This conclusion is not very surprising if one looks at the motion 
sensitive neurons of the fly (see the review by Taylor and Krapp, 
2007) . However, one might wonder what the point of a visual feed- 
back loop may be for controlling the orientation of the visual axes 
(the gaze) in order to minimize the retinal slip speed. In addi- 
tion, this closed-loop control system seems to depend on the fly's 
ability to detect and measure angular target movements which are 
smaller than the interommatidial angle. In their study on the hov- 
erfly's flight behavior, Collett and Land concluded that binocular 
triangulation cannot be achieved by the male hoverfly because it 
would require a resolution equal to 1/40 of the interommatidial 
angle. This resolution was qualified by these authors as unrealis- 
tic. However, if one of the possible roles of these retinal micro- 
movements is to enhance the resolution, as found to be the case in 
many studies on artificial vibrating eyes (see Section "Bio-Inspired 
Visual Sensors Mimicking Animals' Micro Eye Movements"), the 
occurrence of binocular triangulation would be perfectly feasible, 



and this might explain the vergence eye movements observed by 
Franceschini et al. (1991). 

Although Zaagman et al. (1977) recorded responses of hor- 
izontally selective movement detectors to step displacements of 
a grating which were smaller than the interommatidial angle, no 
clear-cut evidence of motion hyperacuity (see Section "Some Find- 
ings on Visual Acuity" ) has been obtained so far in the fly. However, 
many interesting questions arose as the result of Qi and Northrop's 
experiments: these authors were the first to suggest that a closed- 
loop control system may be responsible for the eye muscle activity 
observed (see Figure 3). The exact role of this control system still 
remains to be determined, however. 

3. SOME FINDINGS ON VISUAL ACUITY 

As we will see in Section "Bio-Inspired Visual Sensors Mimicking 
Animals' Micro Eye Movements", artificial miniature eye move- 
ments and retinal micro-movements promote hyperacuity. At this 
stage, it is important to remember the fundamental difference 
existing between the following concepts: 

• Hyperacuity: the ability to locate of a feature (such as contrast- 
ing bars or edges), regardless of its exact nature, with a greater 
accuracy than that corresponding to the resolution imposed by 
the photoreceptor's limited pitch (Westheimer, 1981, 2009). 

• Motion hyperacuity: the ability to detect angular movements 
smaller than the resolution imposed by the limitations of the 
optics (the interreceptor angle in the case of a camerular eye, or 
the interommatidial angle in that of a compound eye). Jumping 
spiders (Salticidae) are able, for example, to detect tiny displace- 
ments of a small target moving in the field of view of its anterior 
lateral eyes (Zurek and Nelson, 2012). 

• Temporal hyperacuity: the ability to detect temporal disparities 
in the microsecond range, as occurs, for example, at the level of 
single neurons in electric fish (Kawasaki et al, 1988). 

• Vernier acuity: the ability to distinguish between a closely spaced 
pair of lines. Hennig et al. have established mathematically that 
the human eye tremor can improve the spatial resolution and 
induce hyperacute responses to Vernier stimuli (Hennig and 
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Worgotter, 2004). In their fine model for human visual percep- 
tion including the Gaussian receptive fields of the ganglion cells, 
Donner and Hemila (2007) have established that micro-saccades 
can help to distinguish between closely spaced lines. 

The various artificial vibrating eyes and bio-inspired aerial robots 
presented in Section "Bio-Inspired Visual Sensors Mimicking Ani- 
mals' Micro Eye Movements" are able to locate contrasting bars 
or edges with a greater accuracy than that imposed by the nar- 
row interommatidial angle. These eyes can therefore be said to be 
genuine position sensing devices endowed with hyperacuity. 

4. BIO-INSPIRED VISUAL SENSORS MIMICKING ANIMALS' 
MICRO-EYE MOVEMENTS 

This active compound eye features two properties that are usually 
banned by optic sensor designers because they detract from the 
sharpness of the resulting images: optical blurring (see Stavenga, 
2003 for review) and vibration (see Section "Retinal Micro- 
Movements in the Fly's Compound Eye: A Review"). The active 
visual principle adopted in the various applications described in 
this section is based on a graded periodic back-and-forth eye 
rotation of a few degrees scanning the visual environment. 

In 1996, Mura and Franceschini developed the first micro- 
scanning sensor based on the periodic retinal micro-movements 
observed in the fly (Mura and Franceschini, 1996). Thanks to its 
motion hyperacuity, this scanning eye was capable of detecting 
low levels of translational optic flow such as those encountered 
by a mobile robot around its heading direction (the focus of 
expansion). This was followed by the development of another 
micro-scanning visual sensor (Viollet and Franceschini, 1999a), 
which enabled a small aerial robot to locate a moving target, 



fixate it, and follow it smoothly (Viollet and Franceschini, 1999b, 
2001). Several attempts (see Figures 4A-C) have been made to 
develop bio-inspired scanning sensors based on vibrating optic 
fibers (Mura and Shimoyama, 1998), a compound eye structure 
(Hoshino et al., 2000, 200 1), passive structure (Landolt and Mitros, 
2001), an actuated mirror (Landolt and Mitros, 2001), and even 
a tiny eccentric mechanism (Juston and Viollet, 2012). In these 
studies, an active visual process was mainly used to improve the 
detection of slowly moving targets. In the field of mechatronics, 
active movements applied to the optic fibers of a visual sensor 
have been used in several industrial applications to read bar codes 
(Yeatman et al, 2004). 

Many visual sensors based on active retinal micro-movements 
have been used for various purposes, such as enhancing edge detec- 
tion (Ando, 1988; Prokopowicz and Cooper, 1995; Hongler et al., 
2003) and improving obstacle avoidance (Mura and Shimoyama, 
1998). However, few studies have focused so far on the use of 
retinal vibrations to enhance visual acuity. Visual scanning at a 
variable angular speed was previously used to enhance the res- 
olution by a factor of 40 in an edge-locating task (Viollet and 
Franceschini, 1999a,b), and more recently by a factor of 70 (Vio- 
llet and Franceschini, 2010). A pulsed-scanning mode was found 
to help a mobile robot detect the simple presence of edges in 
its visual field (Mura and Shimoyama, 1998). A circular micro- 
scanning mode was developed to improve the spatial resolution 
by transforming spatial information into temporal information 
(Landolt and Mitros, 2001). This same mode was also used to 
obtain line or edge operators by correlating a modulating signal 
with the output signals emitted by a 2-D imager (Ando, 1988). A 
recent study (Kerhuel et al., 2012) has focused on the processing 
of the amplitude of the photodector's output signals. By applying 
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FIGURE 4 | (A) A one-chip scanning sensor obtained using a 
photolithographic process. The back-and-forth movement of the visual 
axes was implemented here via an electrostatically driven scanning slit 
placed over the photodiodes [reproduced with permission from 
Hoshino et al. (2001 )]. (B) A visual scanning sensor inspired by the 
spiders retinal movements. The passive scanning movements were 



powered here by environmental vibrations applied to the device 
(Landolt and Mitros, 2001). (C) Bio-inspired hyperacute vibrating eye 
composed of 6 pixels placed behind a fixed lens. The micro-scanning 
movement imposed to the whole eye was implemented by means of a 
tiny eccentric mechanism coupled to a small stepper motor (Juston 
and Viollet, 2012). 
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FIGURE 5 | Three generations of twin-rotor robots equipped with a 
vibrating eye inspired by the micro-movements of the fly's retina 
(see Section "Retinal Micro-Movements in the Fly's Compound Eye: 
A Review"). All these sighted robots are endowed with hyperacuity, i.e., 
they are able to locate and smoothly track a moving target with a much 
greater accuracy than that imposed by limitations of the pixel pitch of their 
eyes. (A) The 100-g OSCAR robot with an eye composed of only 2 pixels, 
scanning back and forth at a frequency of 10 Hz with an amplitude of 9° 



(Viollet and Franceschini, 1999a,b, 2001). (B)The VODKA robot equipped 
with its scanning eye, on which periodic micro-scanning movements were 
imposed by means of a piezo bender translating the two photodiodes 
placed behind a fixed lens (Kerhuel et al., 2007, 2010, 2012). The VODKA 
robot was able to locate a contrasting feature with a 900 times greater 
accuracy than its static optical resolution (without any micro-movements 
of the eye). (C)The HyperRob robot equipped with the active version of 
the artificial curved compound eye called CurvACE (Floreano et al., 2013). 



sinusoidal micro-scanning movements to a retina composed of 
only 2 pixels, it was established that the ratio between the difference 
and the sum of the differentiated photodetector signals can lead to 
an outstanding degree of hyperacuity, which was 900 times higher 
than the interreceptor angle (2.87°). Figure 5 shows three gener- 
ations of bio-inspired sighted aerial robotic platforms equipped 
with either an eye with a vibrating retina comprising only two 
pixels (Figures 5A,B) or an artificial compound eye (Floreano 
et al, 2013) subjected to a periodic micro-scanning movement. 
All these robots are endowed with hyperacuity, and they can lock 
their gaze onto a moving contrasting target (bars or edges) and 
track it smoothly by automatically controlling the orientation of 
their eye (in the case of the robots shown in Figures 5B,C) and 
thus, the orientation of their body (their heading). Table 1 sum- 
marizes the features of the different scanning sensors inspired by 
the fly's retinal micro -movements and the benefits of the visual 
scanning in terms of optical resolution enhancement. 



Finally, the authors of another recent study (Juston et al., 201 1) 
have shown that micro-movements of this kind can enable a visual 
scanning sensor to locate the horizontal roof of a distant building 
(56 m) with a resolution (0.025°), which is at least 160-fold greater 
than the sensors static resolution (4°). In addition, phase analysis 
of the modulated visual signals led to the development of a novel 
edge-bar detector (Juston et al., 2014): it turned out that if the 
contrasting feature is a bar, the phase difference between the two 
modulated signals will be 180°, whereas in the case of an edge, it 
will be null (see Juston et al, 2014 for further details). 

5. SUGGESTIONS FOR FUTURE RESEARCH 

It would be interesting to check the MOT responses of a fixed 
walking fly placed in front of a moving target, the linear position 
of which is controlled in a closed-loop mode (see Figure 6). As 
described by Northrop and Qi (Northrop, 2001), a target moving 
laterally to-and-fro in front of a walking fly triggers MOT activity, 
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Table 1 | Summary of bio-inspired visual scanning sensors. 



Scanning technique 


Reference 


Scanning 
amplitude (°) 


Scanning 
frequency (Hz) 


Optical resolution 
without/with 
scanning (°) 


Benefit of the scanning 


Galvanometer 


Mura and Franceschini (1996) 


6 


50 


3 


Detection low optic flow 


Magnetic coil 


Mura and Shimoyama (1998) 


6 


7 


3 


Motion hyperacuity 


Servomotor 


Viollet and Franceschini (1999a) 


8 


10 


5/0.05 


Hyperacuity 


Piezo actuator 


Hoshino et al. (2001) 


7 


5 


3.2 


Motion hyperacuity 


Scanning slit (electrostatic) 


Hoshino et al. (2001) 


3 


5-20 


5/0.5 


Hyperacuity 


Piezo actuator 


Viollet and Franceschini (2010) 


5.6 


10 


2 8/0.04 


Hyperacuity 


Piezo actuator 


Kerhuel etal. (2012) 


0.2 


40 


2.87/0.003 


Hyperacuity 


Piezo actuator 


Juston et al. (2014) 


8.4 


50 


4.2/0.025 


Hyperacuity 



Whenever a visual sensor was endowed with hyperacuity, its dynamic resolution (with scanning) is given in bold. 
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FIGURE 6 | (A) Simplified diagram of a fixed fly walking on a track ball 
while its MOT response to the laterally to-and-fro moving target 
placed in front of it is recorded. (B) Closed-loop control of the target's 
speed depending on the MOT activity. If the MOT control system is 
correlated with the speed of the target, then the latter will remain 
stationary regardless of the speed reference input signal. In the 



which is correlated with the speed of the target. Under the closed- 
loop conditions presented in Figure 6B, the target's motion will be 
controlled by the error between a reference input signal (a sinu- 
soidal signal, for example) and the angular speed of the visual axes 
estimated by recording the MOT activity. Therefore, if the rotation 
of the visual axes faithfully follows the motion imposed on the tar- 
get, the feedback loop controlling the speed described in Figure 6B 
will completely immobilize the target. It is assumed here that the 
MOT activity is scaled to match the angular speed of the visual 
axes. This scaling can be applied via the DPP. It is also assumed 
that the time required to make the target move in response to any 
change in the MOT activity is very short. 

In the fixed walking fly, it has been established that the MOT 
activity is quasi periodic and that it has a much larger ampli- 
tude (see Franceschini and Chagneux, 1997) than that recorded 
in a stationary fixed fly. In addition, it might be worth using the 
setup described in Figure 6A to test the responses of motion sen- 
sitive neurons (such as the Hl-cells) to step displacements smaller 
than the interommatidial angle, while concomitantly recording 
the MOT activity (as suggested by Zaagman in Colliphora, see 
Zaagman et al., 1977). 

6. SUMMARY 

The present review deals with studies dating back to the 70s 
on the fly's retinal micro-movements and the development 



closed-loop scheme presented here, a second feedback-loop has 
been added to that proposed by Northrop and Qi (see Figure 3): in 
this case, the input signal is the target speed and the output signal is 
the angular speed of the visual axes. The switch makes it possible to 
open or close the feedback loop, depending on the experimental 
procedure used. 



of bio-inspired visual sensors involving similar miniature eye 
movements. Although no direct connection between retinal eye 
movements and visual hyperacuity has yet been clearly established, 
several experiments on humans and animals tend to prove that this 
active visual process may improve the resolution well beyond the 
static resolution imposed by the limitations of the optics. Stud- 
ies on retinal movements and miniature robotic eye movements 
(micro-saccades) have not yet brought to light all the possible 
means of improving the detection and localization of contrast- 
ing features. A great deal of research is still required before it will 
be possible to specify the role of micro-eye movements, which 
cannot simply be reduced to a means of preventing vision from 
fading away. Some extremely interesting paths of investigation 
have already been opened, however, in the fields of biology and 
robotics, where it has been established, for example, that the accu- 
racy of localization performances can be improved 900-fold in 
comparison with what can be achieved using the low resolution 
imposed by the optics (see Section "Bio-Inspired Visual Sensors 
Mimicking Animals' Micro Eye Movements"). There is still room 
for new approaches which may lead to the development of inno- 
vative sensing devices such as visual odometers and visual sensors 
dedicated to tracking moving 2-D targets in a natural environ- 
ment. As a fair return, there is also room for fundamental research 
projects in which the validity of biological hypotheses can be tested 
on man-made machines and sensors. 
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